ISO/IEC/IEEE 29119: The New International Software Testing Standards

In May 2007 ISO formed a working group to develop a new set of standards on software testing – a new area for ISO – the first three of these standards were published in early September 2013. This initiative is closely-supported by IEEE and BSI, both of which have donated existing standards as source documents to the project (these standards will be retired as the new standards are published). The new ISO/IEC/IEEE 29119 Software Testing standards currently comprise five parts. The first covers ‘concepts and terminology’, the second ‘test processes’, the third ‘test documentation’, the fourth ‘test techniques’ and the fifth ‘keyword-driven testing’. There is also a further complementary part in the pipeline on ‘test assessment’. This paper describes the rationale for developing these standards, progress on their development and the content of the different parts. Parts of ISO/IEC/IEEE 29119 have already been released in draft form for review (and subsequently been updated based on many thousands of comments) and are already being used within a number of multi-national organizations. These organizations are already seeing the benefits of reusing the welldefined processes and documentation provided by standards reflecting current industry best practices. Introduction Background to Software Testing Software testing has been a fundamental part of software development since well before life cycle models were defined, with references to a separate software testing activity being made as early as 1954. Today estimates for the proportion of life cycle costs spent on testing vary from below 20% up to 80% for safety-critical systems. Despite its long history and high costs, testing has been poorly covered in standards; this corresponds with similar poor coverage in academic courses and research. This paper introduces a new set of software testing standards, the development of which started in 2007, with the first parts being published in September 2013.